Conversation-Based Assessments in Education: Design, Implementation, and Cognitive Walkthroughs for Usability Testing

نویسندگان

چکیده

Conversational agents have been widely used in education to support student learning. There recent attempts design and use conversational conduct assessments (i.e., conversation-based assessments: CBA). In this study, we developed CBA with constructed selected-response tests using Rasa—an artificial intelligence-based tool. was deployed via Google Chat formative assessment. We evaluated (1) its performance answering students’ responses (2) usability cognitive walkthroughs conducted by external evaluators. constructed-response consistently matched the appropriate conversation paths most cases. comparison, demonstrated perfect accuracy between system implementation. A walkthrough of showed as well several potential issues that could be improved. Participating students did not experience these issues, however, reported them help researchers, designers, practitioners improve assessment for CBA.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Testing Website Usability in Spanish-Speaking Academia through Heuristic Evaluation and Cognitive Walkthroughs

Although usability evaluations have been focused on assessing different contexts of use, no proper specifications have been addressed towards the particular environment of academic websites in the Spanish-speaking context of use. Considering that this context involves hundreds of millions of potential users, the AIPO Association is running the UsabAIPO Project. The ultimate goal is to promote a...

متن کامل

Cognitive Maps to Visualise Clinical Cases in Handovers. Design, Implementation, Usability, and Attractiveness Testing.

BACKGROUND Clinical handovers at changes of shifts are typical scenarios of time restricted and information intensive communication, which are highly cognitively demanding. The currently available applications supporting handovers typically present complex information in a textual checklist-like manner. This presentation style has been criticised for not meeting the specific user requirements. ...

متن کامل

development and implementation of an optimized control strategy for induction machine in an electric vehicle

in the area of automotive engineering there is a tendency to more electrification of power train. in this work control of an induction machine for the application of electric vehicle is investigated. through the changing operating point of the machine, adapting the rotor magnetization current seems to be useful to increase the machines efficiency. in the literature there are many approaches wh...

15 صفحه اول

Design and Implementation of a Web directory for Medical Education (WDME): a Tool to Facilitate Research in Medical Education

Introduction: Access to the medical education resources on the web is one of current challenges for researchers and medical science educators. The purpose of current project was to design and implement a comprehensive and specific subject/web directory of medical education. Methods: First, the categories to be incorporated in the directory were defined through reviewing related directories an...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Educational Technology Systems

سال: 2023

ISSN: ['1541-3810', '0047-2395']

DOI: https://doi.org/10.1177/00472395231178943